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§  1  Introduction 


Let  X  denote  a  random  variable  from  the  exponential  family  having  density  function 

f(x\8)  =  c(9)exp{9x}h(x),  —oo<a<x<P<+oo,  (1.1) 

where  h(x)  is  continuous,  positive  for  x  G  (a, (3),  9  is  the  natural  parameter,  distributed 
according  to  an  unknown  prior  distribution  G  on  the  parameter  space  Q,  =  {9  :  c(8)  >  0}. 

We  consider  the  problem  of  testing  the  hypotheses  H$  :  9  <  9q  verses  H i  :  9  >  90, 
where  #o  £  fb 

Let  a  —  i  be  the  action  in  favor  of  Hi.  For  the  parameter  9  and  action  a,  we  use  the 
loss  function 

1(9,  a)  =  a(90  —  9)I\e<e0 ]  +  (1  —  a) (6*  —  #o)-f[0>0o]>  (1-2) 

where  /[.]  is  the  indicator  function,  which  equals  1  or  0  if  the  statement  inside  [  ]  is  true 
or  not.  Assume  that  \9\dG(9)  <  oo.  Define 


and 

By  Fubini  Theorem, 


aG(x )  =  f  c(9)e0xdG(9), 
Jn 

iPg(x)  =  [  9c(9)e0xdG(9). 
Jn 


(  h(x)ac(x)dx  (1-3) 
Jet 

=  J  h(x)  £  c(9)edxdG(9)dx 

=  f  f  c(9)e0xh(x)dxdG(9)  = 
JQ  Ja 


and 


< 


[  h(x)\xpG(x)\dx  (1.4) 

Ja 

J  h(x)  \9\c(9)e0xdG(9)dx 
Jj9\  J0  c(9)e0xdxdG(9) 
l  \9\dG(9) 


<  oo. 

Let  W(x)  =  8q(xg(x)  —  i)(x).  Then  W(rr)  is  a  continuous  function.  By  (1.3)  and  (1.4), 

rP 


< 


[  \W(x)\h(x)dx 
J  a 

[  [\90\aG(x)  +  \i)G(x)\]h(x)dx 

J  a 


<  OO. 


(1.5) 
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(1.6) 


A  test  5(:r)  is  defined  to  be  a  measurable  mapping  from  (a,  f3)  into  [0,1]  so  that 
<$(a;)  =  P{  accepting  Hi \ X  =  x},  i.e.,  <$(:r)  is  the  probability  of  accepting  Hi  when 
X  =  x  is  observed. 

Let  R(G,  5)  denote  the  Bayes  risk  of  the  test  6  when  G  is  the  prior  distribution.  Then 
Bayes  risk  R(G,  6)  can  be  expressed  as 

R(G,6)  =  CG+  [  fP  5(x){90-e)c(d)e9xh(x)dxdG{9) 

JQ  Ja 

=  CG  +  J  d(x )[J  (90  -  9)c{9)eexdG(9)]h(x)dx 
=  CG+  [  5(o:)[^oQ!g(^)  -  ipG(x)]h{x)dx 

Ja 

=  CG+  f3  5(x)W{x)h{x)dx 
Ja 
rP 

=  CG+  6(x)[90  -  <f>G(x)]aG(x)h(x)dx, 

Ja 

CG=  f  (6-9o)I[0>eo)dG(9), 

j  n 

^g(x) 


where 

and 


4>g(x)  =  E[9\X  =  x  = 


aG(x) ' 


Here,  (f>G{x)  is  the  posterior  mean  of  9  given  X  =  x.  (f>G(x)  is  continuous  and  increasing 
in  x. 

Prom  (1.6),  we  see  that  a  Bayes  test  SG  is  determined  by 

c  /  \ \  1  if  W(x)  <  0  .  s 

5g ^)  {  0  if  W(x)  >  0 


-I 


1  if  <j>G{x)  >  90 
0  if  <j>G{x)  <  9q. 


(1.8) 


The  minimum  Bayes  risk  is 

R(G,Sg)  —  CG  +  [  6G(x)W(x)h(x)dx. 
Ja 

To  exclude  trivial  cases,  we  assume  that 


lim  4>g(x)  <  90  <  lim  d>G(x). 

xAa  x  7  x-yp 


(1,9) 

(1,10) 


From  (1.10),  we  get  that  4>G(x)  is  stictly  increasing  and  there  exists  the  unique  point  b0 
(critical  value)  such  that  (j)G(b0 )  =  #o-  <I>g(x)  <  9o  for  x  <b0,  and  (f>G(x)  >  90  for  x  >  b0. 
Therefore,  the  Bayes  test  SG  can  be  represented  as 


SG(x)  = 


1  if  x  >  b0 
0  if  x  <  b0. 
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Furthermore  we  assume  that  there  exist  two  known  constants  C\,  C2,  a  <  Ci  <  C2  <  P 
such  that 


Ci  <  bo  <  C2. 


(1.11) 


We  will  deal  with  this  testing  problem  via  the  empirical  Bayes  approach.  The  empiri¬ 
cal  Bayes  approach  was  introduced  first  by  Robbins  (1956, 1964).  Let  Xi,  X2,  •  •  • ,  Xn  de¬ 
note  the  observations  from  n  independent  past  experiences.  Denote  Xn  =  (ATi,  X2 ,  •  •  • ,  Xn ) 
Let  X  be  the  present  observation.  An  empiricalJBayes  test  8n(X,Xn)  is  defined^  to  be 
the  probability  of  accepting  Hi  when  X  and  Xn  are  observed.  Let  R(G,8n\Xn)  de¬ 
note  the  Bayes  risk  of  8n  conditioning  on  Xn  and  R(G,8)  =  E[R(G,8\Xn)]  the  overall 
(unconditional)  Bayes  risk  of  8n. 

Since  R(G,8q)  is  the  minimum  Bayes  risk,  R(G,  5n|Wn)  —  R(G,8q)  >  0  for  all  Xn 
and  for  all  n.  Thus,  the  regret  R(G,  8q)  —  R(G ,  8q)  >  0  for  all  n.  The  nonnegative  regret 
R(G,  8n)  —  R(G,  8q )  is  often  used  as  a  measure  of  performence  of  the  empirical  Bayes 
test  of  8n. 

Johns  and  Van  Ryzin  (1972)  constructed  empirical  Bayes  tests  for  the  continuous  one- 
parameter  exponential  family  and  studied  the  rate  of  convergence  for  their  associated 
regrets.  Van  Houwelingen  (1976)  improved  Johns  and  Van  Ryzin’s  result  by  using  the 
monotonicity  of  the  testing  problem  and  showed  that  the  empirical  Bayes  tests  there  have 
a  convergence  rate  of  order  0(n~2r^2r+sHog2(n)),  where  r  >  1  is  an  integer,  associated 
with  the  moment  condition  that  fn  \0\r+ldG{9)  <  00  and  the  r-times  differentiability 
condition  on  m{x).  Under  the  assumptions  fn  \6\rJrXdG(9)  <  00,  (1.11),  and  a  few  others, 
Karunamuni  and  Yang  (1995)  claimed  that  the  empirical  Bayes  tests,  constructed  by 
them,  achieve  an  exact  rate  of  convergence  of  order  0(n~2r^2T+3^).  Note  that  if  r  is 
small,  these  rates  are  still  slow.  Recently,  Liang  (1999)  investigated  the  empirical  Bayes 
test  for  the  positive  exponential  family  and  much  improved  the  previous  results.  His 
paper  shows  that  the  empirical  Bayes  tests  there  have  a  rate  of  convergence  of  order 
0(n~s/(s+3)),  where  s  >  0  is  any  prespecified  number,  under  the  (weaker)  condition 
/0°°  9dG(6)  <  00  and  (1.11). 

Our  research  interest  on  empirical  Bayes  tests  is  motivated  by  Liang  (1999).  Making 
full  use  of  properties  of  W (#),  with  the  help  of  classical  result  about  sum  of  i.i.d.  random 
variables,  under  the  assumption  that  fQ  \$\dG(9)  <  00  and  (1.11),  we  show  that,  for 
any  0  <  e  <  1,  the  empirical  Bayes  tests  can  be  constructed  such  that  they  have  a 
convergence  rate  of  order  o(n~1+e).  Thus  our  result  generalizes  the  result  of  Liang(1999) 
from  the  positive  (one-parameter)  exponential  family  to  any  continuous  one-parameter 
exponential  family. 

The  paper  is  organized  as  follows:  §1  gives  the  introduction;  §2  constructs  a  empirical 
Bayes  test  8n;  §3  proves  that  the  empirical  Bayes  test  has  a  convergence  rate  of  order 
o(n~1+e).  §4  proves  the  lemmas  stated  in  §3. 
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§  2  Construction  of  Empirical  Bayes  Tests 


We  use  the  kernel  method  to  construct  the  empirical  Bayes  tests.  The  idea  here  is 
similar  to  that  of  Stijnen  (1985)  and  Liang  (1999). 

For  any  0  <  e  <  1,  take  integer  m  such  that  me  >  4.  Suppose  [a,b]  is  a  finite 
closed  interval  inside  (a,  (3).  For  each  i  =  0, 1,  let  Ki(y)  be  a  Borel-measurable,  bounded 
function  vanishing  outside  the  interal  [a,  b]  and  for  Ko(y ) 


[byiK0(y)dy  = 

Ja 


1  if  j  =  0, 

0  if  j  =  1,2,  1, 


(2.1) 


and  for  K\(y) 


f  y°Kx{y)dy 
Ja 


0  if  j  =  0,2,3, 
1  if  j  =  1. 


(2.2) 


We  may  let  B 2  be  a  positive  constant  such  that  \Ki(y)\  <  B2  for  all  y  e  [a,  6]  and  i  =  0 
or  1. 

Let  u  =  u(n )  =  Then  u  — >■  0  as  n  — »  00.  For  any  x  €  (a,  /3),  define 


and 


«»w  =  4-i :mx\,  Xvh(xj), 

nu  u 

(2.3) 

m*)  =  ^±mx’u  Xmxiy 

(2,4) 

Let  Wn{x)  =  60an(x)  —  V’n(z)-  We  shall  show  later  that  Wn{x)  ia  an  asymptotically 
unbiased  and  consistent  estimators  of  W(x)  (Lemma  3.2).  Recalling  that  the  critical 
value  b0  is  inside  [Ci,  C2],  then  an  empirical  Bayes  test  5n(x,Xn)  can  be  proposed  by 


f  1  if  (x  >  C2)  or  (Ci  <x  <  C2  and  Wn(x )  <  0), 
|  0  if  (x  <  Ci)  or  (Ci  <  x  <  C2  and  Wn(a;)  >  0). 


The  conditional  Bayes  risk  of  the  empirical  Bayes  test  8n  is: 

R(G,8n\Xn)  =  CG+  [  5n(x)W(x)h(x)dx.  (2.6) 

Ja 

Note  that  W(x)  <  0  if  x  G  [Cx,  60];  W (x)  >  0  if  a:  G  [ b0,C2 ].  Then  the  conditional  regret 
can  be  expressed  as 


R(G,5n\Xn)  -  R(G,5) 


f  (5n  —  8)W (x)h(x)dx 
Ja 
rb  0 

/  V»W<»  \W(x)h(x)dx 

J  C 1 

fC2 

+  /  I[wn(x)>0]\W  (x)\h(x)dx 

Jbn 


(2.7) 
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and  the  unconditional  regret  becomes 


R(G,5n)  -  R(G,S)  =  [b°  P(Wn(x)  <0)W(x)h(x)dx  (2.8) 

+  [°2  P(Wn(x)  >  0)\W(x)\h(x)dx. 

J  bo 


§3  Asymptotic  Optimality  of  6n(x) 

In  this  section,  we  shall  prove  that  R(G,  5n)  —  R(G ,  Sq)  =  o(n_1+£).  The  convergence 
rate  of  R(G,8n)  —  R(G,8a)  depends  on  the  properties  of  W{x)  and  Wn(x).  The  more 
information  about  W(x)  and  Wn(x)  (inlcuding  h(x))  is  used,  the  more  accurate  rate 
we  will  get.  So  firstly,  we  dig  out  a  few  properties  of  W(x)  and  Wn(x).  That  is  a  few 
lemmas,  whose  proofs  are  left  to  §4.  Then  we  state  two  well-known  facts.  Following 
that,  a  desired  convergence  rate  of  R(G ,  5n)  —  R(G,  Sg )  is  given  as  a  theorem. 

The  first  lemma  is  concerned  about  W(x),  which  gives  us  a  solution  to  deal  with  the 
case  that  W(x)  is  small,  but  not  small  enough. 

Lemma  3.1  For  any  p  >  0,  define  l(rj)  =  /^2 1[\w(x)\<ri]dx ,  the  Lebesgue  measure  of 
{x  :  |W(a:)|  <  rf}  fl  [61,62].  Then  there  exists  an  rj0  >  0  and  some  positive  constant 
B3  >  0  such  that,  for  any  r\  <  r]o, 

Kv)  <  BsV-  (3.1) 


Next  we  consider  Wn(x).  We  have  two  lemmas,  which  are  direct  results  of  computa¬ 
tions.  Note  that 

Wn{x)  =  90an(x)  ~i>n(x)  =  -jrV(Xj,x,n),  (3.2) 


nr=  1 


where 


v(x.  x  n)  -  eJL  x  _  1  x  thtiSl 

'  ”  ’  '  u  MX,)  V?  MX,)  ■ 


(3.3) 


Let  W(x,n)  =  E[V(Xj,x,n)]  and  Zjn  =  V(Xj,x,n)  —  W(x,  n).  Then  we  have 
Lemma  3.2  W(x,  n)  can  be  expressed  as 

W(x,  n)  =  W{x)  +  umW{x,  n), 

where  W(x,n)  is  somefunction  such  that  \W(x,n)\  <  for  all  x  £  [6'i,6,2]  andn  >  N\, 
and  where  B4  is  some  positive  number  and  N4  is  some  integer. 
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Also,  we  have 

Lemma  3.3  For  any  fixed  n,  Zjn  are  i.i.d.  and 

EZjn  =  0,  EZ]n  =  \d2(x,  n),  E\Zjn\3  =  \d3(x,  n), 

J  U  u 

where  D2(x,  n)  and  D2(x,  n)  are  some  functions  such  that  D2(x,  n )  <  B$,  D2(x,n)  <  B 5, 
<  B5  for  all  £  €  [Ci,  C2]  and  n  >  N\,  and  where  B$  is  some  positive  number  and 
Ni  is  same  as  in  Lemma  3.2. 


From  Lemma  3.3,  we  see  that 


and 


P(Wn(x)  >  0)  =  P(  .  l==YjZjn  >  -y/nv^U^n)W{x,n)),  (3.4) 

yjnEZjn  i=i 

P{Wn(x)  <  0)  =  P(  1  —  Z3n  <  ~\frnPDfUx^n)W(x,  n)).  (3.5) 

\JnEZjnj=i 


Comparing  W(x)  and  W(x,n),  we  get  the  following  useful  result: 

Lemma  3.4  There  exists  an  integer  N2(>  Ar1)  such  that,  for  any  n>  N2  and  x  € 

[Ci,C2], 


and 


1  _  W(x\ 

W(x)>  —  =>  W(x,n)  >  0  and  =— — -  <  2, 
n  W(x,n) 


1  _  W(x) 

W(x)  < - =►  W(x,n)  <  0  and  |_.v  \\ <  2. 

n  W(x,n ) 


(3.6) 

(3.7) 


Lemma  3.4  allows  us  to  replace  W(x,n)  with  W(x)  in  (3.4)  and  (3.5).  That  makes 
things  a  little  easier  since  W ( x )  does  not  depend  on  n  and  has  a  few  good  properties. 

Next  we  state  two  general  well-known  results.  One  is  about  the  non-uniform  estimate 
of  the  distance  between  the  distribution  of  a  sum  of  i.i.d.  random  variables  and  the 
normal  distribution;  the  other  is  about  the  normal  quantile  bounds. 

Result  A  Let  X\,X2,  ■  ■  • ,  Xn  be  i.i.d  random  variables,  EX\  =  0,  EX\  =  a2  >  0, 
jE'IXiI3  <  00.  Then  for  all  x 

\Fn(x)-^{x)\<A-^j^-  ^1)3  •  (3-8) 
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Here  ty(x)  is  the  c.d.f.  of  N( 0,1),  Fn(x)  and  p  are  given  by 


E\Xx\ 


=  P  =  ■ 

Remark  Result  A  can  be  found  in  Petrov  (1975,  ppl25  Theorem  14)  or  Michel 
(1981).  Here  A  is  independent  of  n.  Michel  proved  A  <  30.54. 


Result  B  Let  ty(x)  be  the  c.d.f.  of  N( 0, 1).  Then  for  some  constant  Bq  >  0, 


x  >  0 


*(*)  =  [ 
Jx 


oo  1 


B 
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— 7=e  2  dx  <  — -e  2 
V27T  x 


and 


x 


/x  i  x2  x2 

—7=e  2  dx  <  — e  2 

-00  V27T  \x 


Combining  (3.8),  (3.9)  and  (3.10),  we  see  that,  for  any  fixed  n, 
if  x  >  0, 


if  x  <  0, 


Pi-Ay  x,  >  z) 

=  1  -  Fn{x) 

<  1  —  4/ (a;)  +  A 


Bq  _£l 


\/n(l  +  |x|)3 
Ap 


£  |x|e_I +v^W(i  +  W)2' 


(3.11) 


(3.9) 

(3.10) 


i  n 
P{  rE 

= 

Fn(x) 

< 

4/ (a;)  +  A— 

V 

Bq  X2 

< 

Ae--  +  - 

1*1 

main 

result: 

Ap 


(3.12) 


Theorem  3.5  Let  Sn  be  the  empirical  Bayes  test  constructed  in  Section  2.  Then  we 
have,  as  n  —¥  oo, 

nl-e[R(G,6n)-R(G,8)}  0. 
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Proof.  For  convinience,  let  B-?  =  maxc1<i<c2  h(x)  and  B$  =  /<?2  h(x)dx  <  oo.  From 

(2.8), 

R{G,Sn)-R(G,S)  =  [b°  Pn(Wn(x)<0)W(x)h(x)I[0<w{x)<x]dx  (3.13) 

J  C\  71 

+  fbJ  Pn(Wn(x)>0)\W(x)\h(x)I[_ 

±<w{x)<  o]dx 

+  f  °  Pn(Wn{x)  <  0 )W(x)h(x)I[w{x]>i]dx 

J  C  i  n 

+  Jb  2  Pn{Wn(x)  >  0)|W(®)|ft(x)/(lv(!1.)<_i]cIa; 

=  i  +  n  +  m  +  iv. 


Part  I  and  Part  II  are  trivial.  Since  we  have  |W(x)|  <  £  in  both, 


/*fco  1 

/  h(x)dx  <  —B8 
'Ci  n 

(3.14) 

fC2  1 

/  /i(xW:r  <  — J3g. 

n 

(3.15) 

and 


Part  III  and  Part  IV  are  a  little  more  complicated.  We  treat  Part  III  first.  Using  (3.6) 
and  (3.12),  we  have 


III  < 


< 


< 


[  °  P{—F==rYjZin  <  ~\/ruPD^d^^W(x,n))I[mx)>uW{x)h(x)dx 
Jci  nEZjn  j= 1 

[°P(  /  1  =J2Zjn  ^  -  J  7 nw3£)2  1  Ou  w)  W  (x) )  7[Wr(*)>  1  ]  tv  {x)h{x) dx 

JC l  \JnEZjn  3= 1  Z 

fb0  2B6e~nu3D^P^w2P)/8  T  ....  ...  ., 

L 

/>60  2 Au~5D3 (x,  n)W (x)h(x) I[w(x)>±] 

Jc 


< 


ci  [ti-3D2(a:,  n))z!2y/n^nuzD2  x(x,  n)W (x)[l  +  \\JmPD2  1{x,n)W{x)Y 

/•to  2 B6e~nu3DI1P’n^w2(-x^8 
L  /  TWZT7  V 


< 


+ 


L 


ci  nu3  D^1  (x ,  n)  lUV 

bo  2ADz{x,n) 


bo  2  B6e 
>1 

nu2D2(x,n)[  1  4-  ^\JntPD 2(a;,n)VF(rr)] 

■60  OR.p-nU3D~\x,n)W2(x)/8 

,  2^6e.  - JsMx)dx 

Cl  \JnuzD21(x,n) 


2  V(*)> 


i]/i(x)d 


'x 
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+ 


+ 


fb°  2ff6 

•^Cl  ^/n«3D^1(a;,  n) 
jb°  2 AD3(x,n) 


Isch(x)dx 


I Ci  nu2D2(x,n) 
=  V  +  VI  +  VII, 


h(x)dx 


where  S  =  {x  :  e  nu3D2  l(.x,n)w2(x)/8  <  J^j.  and  Sc  =  {x  :  e  nu3D2 
Obviously, 


3  n~1(x,n)W2(x)/8 


VII  <  ~  f°  °i(?'n\h(x)dx  <  ~BhB{ 
nuz  Jci  D2{x,n)  nu 2 


By  our  definition  of  S, 


V  <  -^5=  [  jD2(x,  n)h(x)dx  <  -^=\fW3B&B3. 
nvr  JCi  n\Zu6 


nVv?  Jci 
As  for  Part  VI,  we  have  firstly  that 

nu3D-1(x,n)W2(x)/S 


\fn 


W2(x)  < 
W2(x)  < 
\W(x)\  < 


rt-Jv} 

4D2(x,  n)  logn 


(3.16) 


(3.17) 


mr 


4  B5  log  n 


nu° 


1 4 B$  log  n 
nu 3 


So  J5c  <  /[|w(x)|<7)],  where  r]  =  Note  that  0  as  n  ->  oo  since 

u  =  n_V  Let  N3  >  N2(>  Ni)  be  an  integer  and  such  that  for  n  >  N3,  y/4B^°gn  <  ffo- 
From  Lemma  3.1,  when  n  >  N3, 

2B*,[w^r; 

/Cl 


VI  < 


< 


< 


Vnu ;3 
2B6 
Vnu3 
Vl°gn 
nu 3 


-  /*Oo 

B^B'j  I  I  sc  dx 

JCi 

^  B5B7B3 


(3.18) 


4B5  log  n 


nu° 


4B3B3BqB7. 


Combining  (3.16),  (3.17)  and  (3.18),  we  get  that  when  n  >  V3, 
III  <  -^b5bs  +  —^=Jb5b6b8  +  ^^ab3b5b6b7. 


nu * 


nyu 


nu° 


(3.19) 


Now  we  deal  with  IV.  Using  (3.7)  and  (3.11),  we  get 


IV  <  [  P(-j=L===Y,zjn  >  -y/nu3D21(x,n)W(x,n))I[W(g)<_i]\W(x)\h(x)dx 

Jbo  iJnEZ]nj=i 
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<  [ClP(  7  1  ,  t,Zj„  >  \yJnuW^\x,n)\W(x)\)Imx)<_s.)\W(x)\h(x)ix 

Jbo  \fnEZjn  j= 1  Z 

rC2  2B6e~nu3D^^w^x^8 

~  Jbi 


-Ilw(x)<_i]\W(x)\h(x)dx 


+ 


n)\W{x)\ *lW{x)<  J 
c2  2AD3(x,  n)\W(x)\h(x) 


<  / 

Jbi 


h  nu2D2(x ,  n)|W(x)|[l  +  \^frvu^D2  1(;r)  w)|VF(:r)|]2 
c2  2BGe~nu3Di1(x,n)w2('x^8 


I[w(  x)<-±)dx 


b°  ^Jnu3D2  l(x,  n) 
Ci  2  B6 


-Ish{x)dx 


r 

Jb0 

f 

Jbn 


'bo  \JnuzD2  n) 
"c2  2AD3(x,n) 


I$ch{x)dx 


+  'bo  nu2D2(x,n) 
VIII  +  IX  +  X. 


h(x)dx 


Recalling  S  =  {x  :  e-™3D2\x,n)W*{x)/&  <  and  gc  =  {X  ;  e-n«3C2-l(x,n)W2(*)/ s  > 


obviously, 


VIII  <  -^5=  [  JD2(x,n)h(x)dx  <  ^~=\[bgB, 
n.\ru?  Jbn  n\/u 6 


2  Be, 


n-Vu6  Jb0 


Similarly  to  (3.16), 


X  < 


2A  fc 2  D3(x,n) 


J 

Jb , 


nu2  Jbo  D2(x,n) 
As  for  Part  /X,  similarly  to  Part  VI,  we  have 


24 

h(x)dx  <  —^B5B8. 


nuc 


v/SJ 


(3.20) 


(3-21) 


-nu3D2  1(x,ti)W2(x)/8 


> 


1 

\fn 


W2( x)  < 
W2{x)  < 
\W(x)\  < 


4 D2(x,  n)  logn 


nu° 


4  Bg  log  n 


nu° 


1 4 B5  log  n 
nuz 


When  n  >  N3,  <  r?0  and  J5c  <  ^4b5 iogn,-  From  Lemma  3.1, 

vnw  [|Vv(x)t<  ^ 


/X  <  -=LJb5B7  /  J5cdx  (3.22) 

v  nu3  •'('o 


< 


2 


c2 

6o 


yjnuz 


y/iBl  logn 


V  n?i3 
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(3.23) 


Combining  (3.20),  (3.21)  and  (3.22),  we  get  that  when  n  >  Ns, 

IV  <  ~^=JF5B6Bs  +  —2BbB,  +  ^^4B3B5B6B7. 
nVu 3  v  nu 2  nu3 

From  (3.14),  (3.15)  (3.19)  and  (3.23),  we  get 


R(G,  Sn)  -  R(G ,  S)  <  ~^=JF5B6Bs  +  —2B8B8  +  ^p8 BzB5BeB7}.  (3.24) 


As  n  — >  oo, 


3w  — w —  u —  u  ■  1  q 

.  v  nu 2  rar 


f  nl  =  nl  =  n  5e/8  -►  0; 


n 


1  e\  =  n1  e — TIM  —n  £/2  — >  0; 

mn  ef  *  > 


We  get  that  n1“‘[i2(G,  <5n)  -  i?(G,  5)]  ->  0. 
The  proof  is  completed. 


§  4  Proofs  of  Lemmas 


Proof  of  Lemma  3.1  Since  a(a;)  <  oo  for  all  x,  a^(x)  exists  for  all  x  and  all  l  >  1. 
Then  W^(x)  exists  for  all  x  and  all  l  >  1,  since  ^(x)  =  a'(x).  These  will  be  used  in  the 
proof  of  Lemma  3.2.  Now,  we  need  that 

W'{x)  =  e0  f  0c(0)edx  dG(0)  -  [  02c{0)e9xdG{0).  (4.1) 

J  Cl  Jci 


First,  we  prove  that 


W'(b0)  <  0. 


If  tpG(b0)  =  0,  then  W'(b0)  =  -  fa  02c(0)e9bodG(0)  <  0.  If  i/>G(b0 )  >  0,  then 


W  Sn02c(e)eMG(e)  Jn  0c(0)e9b°dG(0) 

Ml o)  Jn  &c(9)eebodG(9)  l,,c(S'MdGW)  ° 


(4.2) 


Thus  H"(60)  =  ’PcHuM  ~  |^y]  <  0-  If  MW  <  0,  then 

MW  jngf(g)e^jgOT  fat>c(«)etb°dG(9) 

MW  S^c(e)MdG(e)  fnc($y»>dG(e)  0 

Thus  W'(b„)  =  MWtfo  -  f§7^1  <  0.  Then  (4.2)  is  proved. 
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From  (4.1),  we  see  that  W'(x)  is  continuous.  Then  we  can  find  b'0  >  0  such  that,  for 
any  x  e  [b0  -  b'0,  b0  +  b'0]  C  [CUC2], 


-W'(x)  >  i[-W"(6„)|  ee  2 B?. 


(4.3) 


Note  that  W(x)  >0  for  x  G  [Ci,6o);  W(x)  <0  for  x  G  ( bo,C2 ]■  Then 
Vo  =  L  mjn  .,  w(x)\  A  L  min  W{x)}  >  0, 

Ci<x<bo—bQ  bo+b0<x<C2 

where  a  A  b  =  min{a,  b}.  For  77  <  770,  let 

VL  =  {x:W(x)  =  r1,C1<x<C2 }, 

and 

r/R  =  {x  :  W (x)  =  -r),Ci  <  x  <  C2}. 

Since  77  <  770,  Vl  and  77 R  are  unique,  and 

[Vl,  Vr]  C  [60  —  b'0,  b0  +  b'0]. 

Recall  W'(x)  <  0  for  x  G  [b0  -  b'0,  b0  +  b'0 ].  Then  l(r])  =  r]R  -  r}L.  Using  the  slope  formula 
and  (4.3),  we  have 


-77-77 


>  2B3-1. 


Thus 


Vr  -  Vl 
l(v)  <  BoV- 


(4.4) 


Proof  of  Lemma  3.2  Using  Taylor’s  Theorem,  (2.1)  and  (2.2),  a  straight-forword 
computation  shows  that 


(^)i 


(4.5) 


uh(Xj) 

=  /  r-^P-c(e)e’yh(y)dVdG(e) 

Jn  Ja  un{y) 

=  00  [  f  Ko(t)c(6)eexeeutdtdG (0) 

Ja 

=  e0  J^c(6)eex[J*  K0(t)eeutdt]dG{6) 

r  7/^^  fb 

=  do  /  c(0)e6x[  1  +  —T em  /  K0(t)tme9urdt]dG(d) 

Jn  771:  Ja 

=  60  [  c{9)eexdG{9)  +  um  [  909mc(9)eex[—t  t  K0(t)tme6ut‘ dt]dG{9), 
Jn  Jn  771 !  7 a 
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where  \t*\  <  max{|a|,  |6|}  =  c.  Also, 


E[ 


Ki(Zp). 


(4.6) 


u2fc(X,) 
f  rP  K  (y~x) 

=  LL 

=  -  [  t  Kx{t)c{e)e9xe9utdtdG {6) 

U  JO  J a 

=  -  [  c(e)e9x[fb  K^e^dtldGiO) 

U  Jn  Ja 

1  r  «.7Tl"j"l  /*& 

=  -  /  c(6)eex[u6  +  T?——em+1  /  Ki(t)tm+1eeut  dt\dG(9) 
uJa  v  '  L  (m  +  1)!  Ja 


-m+1eeut"dt]dG{d), 


=  /  0c(0)efc<iG(fl)  +  «”*  f  f  A\(f)( 

70  70  [ Tfl  +  1J !  Ja 

where  \t**\  <  max{|a|,  |6|}  =  c.  Prom  (4.5)  and  (4.6),  we  get  that 

E[V{Xj,  x ,  n)]  =  VP  (:r)  +  umW{x ,  n), 

where 

Wfon)  =  0O  f  0mc(9)e9x[^-r  [b  K0{t)tme9ut’ dt]dG(0) 

70  771:  Ja 

-  [  6m+1c(e)edx[7 — 1——  [b  dt]dG (0). 

J a  (m  +  1)!  Ja 

Choose  C  >  0  such  that  a  <  C\  —  (  <  C2  +  C  <  &■  Then,  we  can  find  an  Ni  such  that 
for  n  >  Nu 

uc  <  £.  (4.7) 

Then 

\W(x,n)\  <  B2\e0\cm(b-a)  f  \0\mc(9)eex(ed^  +  e~^)dG(e) 

70 

+B2cm+1(b  -a)  f  1 0|m+1c(0)e**(e*  +  e~ec)dG(d). 

Ja 

Let  mo  be  an  even  number  such  that  m  +  1  <  m0.  Then 

[  \9\mc(6)e9x(e8<  +  e~e<)dG(e) 

Ja 

<  [  c(%to(e^  +  e^)dGW)+  [  6m°c{d)e9x(e9(;  +  e~^)dG(6) 

~  7n[|0|<i]  7n[|s|>i] 

<  /  c(0)e9x(e 9<:  +  e~9t)dG{6)  +  [  6>m° c(9)e9x (e^  +  e~9<:)dG(6) 

70  70 

=  ac(x  +  C)  +  &g{x  ~  C)  +  ^cT^O*-  +  C)  +  oc{g°\x  —  C)- 
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Similarly 


[  \9\m+lc(9)eex(eei  +  e  e<>)dG(9 )  <  aG(x  +  C)  +  aG(x  -  C)  +  a^o)(:r  +  0  +a^no)(a:  -  (). 
Jn 

Since  is  continuous,  it  follows  that 

Bq  =  max  otG(x)  <  oo, 

Ci-c<x<c2+c  v  7 

and 

Bw  =  max  ocq^Hx)  <  oo. 

Ci-C<i<C2+C 

Thus 

|VK(:r,  n)|  <  B2\9o\cm(b  ~  °)  *  2(Z?9  +  -Bio)  +  B2Cm+l(b  —  a)  x  2(Bg  +  Bio)  —  B4  <  00. 


Proof  of  Lemma  3.3  Obviously,  Zjn  are  i.i.d.  for  fixed  n.  A  few  computations 
show  that 


EZi 


]n  u 4 


1  .  -ft  TS  (V~X\  TV-  (y-x\ 

L  L  [l,o“  %)  -  ■ u2w{x’ 

1  f  f\6QuKo{t)  -  Ki(t)  _  uW^ n)]2 c(g)eexeeuth(x  +  ut)dtdG{9) 


=  ~  f  f  [- 

UZ  Jn  Ja 

1  „  ,  . 
=  -zD2(x,u), 


h(  x  +  ut) 


where 


D2(x,u)  =  [  f  -  u2W(x,n)]2c(9)e>>xeVuth(x  +  ut)dtdG(9). 

Jn  Ja  h(x  +  ut) 

Also, 

-1  r  rQ  js  (y-x  \  rs-  (y-x\  _ 

E\Zjn\ 3  =  —f  f  \90u— °Z7^ - ~ - u2W{x,n)\zc{9)eeyh{y)dydG{9) 

'll  J  O.  J  Ol 

ft 

Jn  Ja 


Jjn]  ~  -•  '  ru“  h(y)  h(y) 

1  f  f\90uK0{t)  -  Ki(t)  _  n)\3c{9)eexeeuth{x  +  ut)dtdG{9) 


u° 

=  \d3(x,u), 
ub 


h(x  +  ut) 


where 


D3{x,u)  =  [  [ 

Jn  Ja 


b  JouKoit)  -  Kx(t)  „ 


—  u2W  (x,  n)|3  c(9)e9x  e9ut  h(x  +  ut)dtdG{9). 


h(x  +  ut) 
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When  n  >  Nx,  for  any  x  6  [Cx,  C2]  and  t  £  [a,b\,  x  +  tu  £  [ Cx  —  C,  C2  +  C]  and 

W(x,n)  =  W(x)  +  umW(x,  n) 

<  max  W  (x)  +  umB4 

~  Ci<x<C2  v 

<  max  W  (a;)  +  B4 

C 1  <£E<C2 

=  Bn. 


Let  B12  =  maxx€[Cl-^c2+Q  h^j  <  00  and  Bn  -  maxa.€[c1_<,c2+c]  Kx)  <  00 •  Then,  for 
any  n>  Nx  and  any  x  €  [C\,  C2], 

0ouKo(t)  -  K^t)  _u2  <  (\d0\uB2  +  B2)B12  +  u2Bn 

h(x  +  ut) 

<  (|0O|  +  l)B2Bi2  +  Bu 

=  B14, 


and 


[  fb  c(d)eexeeuth(x  +  ut)dtdG(9) 
J Vi  J a 


<  Bn(b  -  a)  ^c(0)e*VC  +  e“*c)dG(0) 

<  2Sl3(6 

=  B15, 


a)  max  cxg(x) 
xG[Ci-C^2+C] 


Therefore 

D2(x,  n)  <  Bf4B15,  D3(x,  n )  <  B3UBX5,  <  514. 

Letting  J35  =  max{.B14,  Bl4Bx5,  B\ABX3)  <  00,  completes  the  proof. 


Proof  of  Lemma  3.4  Noting  that  u  —  n~ *  and  me  >  4,  num  =  — >•  0  as 

n  ->•  00.  Since  W(x,n)  <  jB4  for  all  a;  e  [Ci,C2]  if  n  >  Nx,  there  exists  an  iV2(>  W) 
such  that  |n«mW(x,n)|  <  |  for  all  x  €  [Ci,(72].  If  W(x)  >  i, 

nPF^n)  -  n[W(x)  +  «mW(x,n)]  =  nW(x)  +  n«mW(x, n)  >1  —  ^  =  ^>0 


and 


W(x) 

W(x,n) 


nW(x) 

nW  (x)  +  numW  (x,  n) 
nW(x)-l  +  l 
-  nW  (x)  —  1  +  | 

<  2. 
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Then  (3.6)  is  proved.  (3.7)  can  be  proved  in  a  similar  way. 

Acknowledgment  We  would  like  to  thank  Prof.  T.  Liang  for  his  helpful  comments  and 
suggestions. 
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